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Abstract 

In this paper we propose an improved approximation scheme for 
the Vector Bin Packing problem (VBP), based on the combination 
. of (near-)optimal solution of the Linear Programming (LP) relaxation 

KS ' and a greedy (modified first-fit) heuristic. The Vector Bin Packing 

^ . problem of higher dimension (d > 2) is not known to have asymptotic 

polynomial-time approximation schemes (unless P = NP). 

Our algorithm improves over the previously-known guarantee of {In 
d -|- 1 -|- e) by Bansal et al. [1] for higher dimensions {d > 2). We 
provide a 6{1) approximation scheme for certain set of inputs for any 
dimension d. More precisely, we provide a 2-OPT algorithm, a result 
which is irrespective of the number of dimensions d. 

1 Introduction 

Packing items of variable sizes into a given space is a fundamental problem 
of combinatorial optimization. This problem dates back to the origin of Op- 



erations Research. The packing problem and it's multidimensional variants 
have vital practical applications in diverse domains including the cutting, 
packaging and other industries. In this paper, we consider a type of packing 
problem called the Vector Bin Packing (Vector Packing) problem and pro- 
pose a better bound for the multidimensional version of the problem. The 
items of variable sizes are packed into containers called bins with fixed size 
along all dimensions. 

Multidimensionality plays an important role in capturing incomparable 
characteristics of the objects that are to be packed. For example, the mem- 
ory requirements and bandwidth requirements in a distributed computing 
environment are incomparable. Multidimensionality also suffices the differ- 
ent costs that may be associated with each of these requirements. In this 
paper, we provide a method which is applicable to any dimension d. 

1.1 Problem Definition 

We now formulate the optimization problem that we are addressing. 

Vector Bin Packing problem (VBP) 

Given a set S of n d-dimensional vectors pi, p2, . . . , Pn from [0,1] , find a 

packing (partition) of S into A\, A2, . ■ . , Am such that J^peA^p'' — ^i ^*' ^ 

(p'' denotes the projection of vector p along 'k'th dimension). The objective 

is minimize the value of m, the number of partitions. 

When d = 1, the problem is an instance of the classical bin packing problem 

(BP). 

1.2 Related work 

One dimensional bin packing problem has been studied extensively. Fer- 
nandez de la Vega and Lueker [7] gave the first asymptotic polynomial-time 
approximation scheme (APTAS). They put forward a rounding technique 
that allowed them to reduce the problem of packing large items to finding 
an optimum packing of just a constant number of items (at a cost of e times 
OPT). Their algorithm was later improved by Karmarkar and Karp [9j, to 
a {l+log^)-OPT bound. 

For 2-dimensional vector bin packing, Woeginger [12j proved that there 
is no APTAS. For higher dimensions, Fernandez de la Vega and Lueker [7J 
proposed a simple {d + e)-OPT algorithm, which extends the idea of 1- 
dimensional bin packing. Chekuri and Khanna [5j showed an 0(log d)- 
approximation algorithm that runs in polynomial time for fixed d. Bansal 



et al. [T] improved this result, showing an (In d + 1 + e)-approximation al- 
gorithm for any e > 0. Karger et al. [8] have recently proposed a polynomial 
approximation scheme for randomized instances of the multidimensional vec- 
tor bin packing using smoothing techniques. Patt-Shamir et al. |llj have 
recently explored the vector bin packing problem with bins of varying sizes 
and propose a (In 2(i + 1 + e)-approximation algorithm for any e > 0. 

1.3 Our results and organization 

In this paper, we provide an improved approximation bound for the vector 
bin packing problem of any dimension. We provide a 9(1) approximation 
guarantee for certain set of inputs for any dimension d. In more specific 
settings, we provide a 2-OPT guarantee for large inputs irrespective of the 
dimension d. This is a notable improvement over the previously known 
guarantee of {In d+ 1 + e) for higher dimensions (d > 2). 

The rest of the paper is organized as follows. Section [2] gives the linear 
program (LP) formulation of the problem. In Section [3l we provide the 
approximation algorithm and prove the bounds. 

2 Problem formulation 

We formulate the problem as an integer program in 12.11 The integer con- 
straints are relaxed and we formulate it's dual (|2.2p . The solution of the 
relaxed integer program gives a thoughtful insight about the optimal num- 
ber of bins. 

2.1 Integer Linear Program (ILP) formulation 

The vector bin packing problem (VBP) can be formulated as an integer 
program. We use two binary variables Xij and yj. The binary variable Xij 
indicates if vector pi is assigned to bin j and the binary variable yj indicates 
whether bin j is in use or not. Our objective is to minimize the number of 
bins used. 

The number of bins m can initially be set to a sufficiently large value 
arrived at by any heuristic (example - de la Vega and Leuker [7] give a 
0(d)-OPT bound on the number of bins). Then, we formulate the integer 
program (ILP) as follows - 



minimize '■ / Vj (1) 

j 
such that y^ Xij = 1 1 < i < n (2) 

j 
^p'l.Xij < 1 l<j<m,l<k<d (3) 

i 

Uj ^ Xij l<i<n,l<j<m (4) 

Xij e {0, 1} 1 <i <n,l < j <m (5) 

The constraints of the ILP are as follows - 

• Constraint (2) states that every vector is packed in a bin. 

• Constraint (3) ensures that the packed vectors do not exceed the bin 
dimensions. 

• Constraint (4) tells whether a bin is used or not. 

• Constraint (5) ensures that a vector is either packed entirely in a bin 
or not. 

Constraint (5) can be relaxed as follows to obtain a linear program (LP). 

Xij >0 ^ < i < n, 1 < J < w. (5a) 

We can obtain a feasible solution for the LP using any standard method [6] . 
Using binary search technique, we can also find the least value ofm,m G Z~^ 
for the relaxed ILP for which a feasible solution exists. The value of m 
thus obtained will be less than the optimal solution for the integer program 
i.e. {m < OPT). However, the solution obtained is usually not integral. 
To tackle this problem, we formulate a dual-maximization problem for the 
above relaxed ILP. 

Theorem 1. /5/ Any basic feasible solution to the relaxed LP deEned by 
Equations\2i\M and\5^has at most d-m vectors that are fractionally assigned 
to more than one bin. 



2.2 Dual-maximization problem 

We introduce several new variables Zij to formulate the dual. The dual- 
maximization problem formulation is given in the Appendix 14.11 We arrive 
at the following set of equations and constraints - 



maximize 

^ 3 



^^XijZij (6) 

i 3 

such that 2, Xij = I 1 < i < n (7) 

j 
"^p^.Xij < 1 l<j<m,l<k<d (8) 

i 

^ %■ < 1 l<j<m (9) 

i 

Xij, Zij > l<i<n,l<j<m (10) 

This is a nonlinear program (NLP) as the objective function is nonlinear. 
Hereafter, we shall refer to it as NLP. 

Lemma 2. The value of the objective function of the nonhnear program 
(NLP) hes between 1 and m. 

Proof. 

Lower bound : Let Zij = -V(i,j). Then, the objective function becomes - 

i 3 i 3 

Upper bound : The value of the objective function is upper bounded as 
follows - 

i 3 i 3 3 i J 

Thus, the range of values the objective function will assume is between 1 
and m. I 

The actual range of values that ^^ ^ • XijZij (given the constraints) is 
to m. The objective function gives us a hint about the utility of the bins. 
Intuitively, if the value of the objective function is k, we can assume that 
the expected utility of each bin is — . 



Lemma 3. In the optimal solution to the nonlinear program (NLP), if any 
values of Xij 's are 0, the corresponding values of Zij 's are 0. 

Proof. Let a^j^ji = for some value of {ii,ji). From constraint @ of the 
nonlinear program, we have - 

i 

Atleast one vector i{i ^ ii) is packed in bin ji (i.e. Xjj^ > 0). For this 
vector i, the value of Zij^ > in the optimal solution. The term X^ j a^iji ^^iji 
is maximized iff the value of Zi-^j^ is redistributed among other Zij^ values 
where Xij^ > 0. Hence, the value of Zi^j^ must be 0. I 

Theorem 4. Given a sufRciently large value ofm{m, > OPT), the solution 
(value of Xij) returned by the nonlinear program NLP will be integral, given 
that Zij is non-zero whenever Xij ^ 0. 

Proof. Consider n vectors which are to be packed. Assume that the the 
optimal packing can be done with 2 bins (i.e. 0PT=2). Without loss of 
generality, let us assume that the vectors 1, 2, . . . , /ci (/ci < n) be packed in 
bin 1, and vectors /ci + 1, /ci + 2, . . . , n be packed in bin 2 in the optimal 
solution OPT. 

That is, let xu = X2i = ■ ■ ■ = Xk^i = ^(^^+1)2 = . . . = Xn2 = 1- The 
maximum value of the objective function in this case will be - 

fei n 

Obj = ^ Zii + ^ Zi2 

i=l j=fci+l 

< 1+1 =2 

Now, let us assume that the vector A;i + 1 be fractionally packable in bin 1 
and bin 2. Let the fraction that can be packed be t(0 < t < 1) in bin 1 and 
(1 — t) in bin 2. The objective function in this case can be shown to be - 

fcl n 

Obj = ^ Zji + t^;(fci+l)l + ^ Zi2 + {1- t)Z(^ki+l)2 
i=l i=ki+2 

< 1 - (1 - t)z(^ki+l)l + 1 - tZ{ki+l)2 

< 2 - (1 - t)z(^ki+l)l - i^(fci+l)2 

<2. 



Similarly, we can extend the same argument when more than 1 vectors 
from bin 2 are fractionally packed in bin 1. The objective function strictly 
decreases as follows - 

ki n n 

Obj = ^ 2ii + ^ Uzii + '^ {'^ - U)zi2 

i=l i=ki i=ki+l 

n n 

< 1 - J2 ^'^~ *^)-^^i + ^ " Z] *^^^2 

i=ki+l i=fci+l 

n n 

< 2 - ^ (1 - U)zil - ^ tiZi2 
i=ki+l i=A:i+l 

<2. 

where ti and (1-tj) are the fractional packings of vector i in bin 1 & 2 
respectively. 

By induction, the same proof can be extended when the number of re- 
quired bins is more than 2 (i.e. OPT > 2). Thus, the maximum value of 
the objective function occurs when the variables Xij are integral. I 

Theorem 5. For the solution to be (near-) optimal and integral, the value 
of Zij should be a function ofxij. 

Proof. The integral part follows from Theorem HI Let us look into the 
optimality of the solution obtained. 

From the Jensen's Inequality, we have that if / is a convex function ( "concave- 
up") on an interval / and Cj € / then for weights Aj summing to 1 - 



/£A.a,)<5^A./(a,) 



i=l 1=1 



We can apply Jensen's inequality with Aj and Oj corresponding to Xij and 
Zij , respectively. The modified set of equations in this case is as follows - 

m m 

fC^XijZij) <'^Xijf{zij) l<i<n (a) 

From the property of convex functions, we have - 

f{tx) < tf{x) 0<t<l (b) 



From (jaj) and ([b]), we have - 

^ n m ^ n m 

f^n ^ ^ ^'^^'^^ - n ^ ^ Xijf{zij) (c) 

Since f{x) is a convex function, any value which maximizes x also maximizes 
f{x) and vice- versa. Hence, from the inequality (jcj), we have that the term 
Xijf{zij) should be maximized for the objective function to be maximized. 
Indirectly, Zij has to be maximized relative to the values of Xij. The value 
of Zij is constrained by the constraint ([9]), and hence we come up with the 
following function for Zij - 



Xi 



U 



Z^i ^ij 



(11) 



4 Z^i ^V 



1 



Thus, from (llip . the objective function is as follows 



Xij , _ 


X^- 




E^^^J 


V^^^^- 



o^j = Y^Y^ ^'j^'^j = YY1 ^^i( 



From the RMS (root mean square) , arithmetic mean and standard deviation 
relation, we have - 



where xrms = \l ^i + ^2 + • • • + ^n (^3) 

V n 

Xl+X2 + ...+X„ 

a^M = (14) 

n 



Cx 



\ 



1 " 

- y^(xi - xmY (15) 



n 



On simplifying ([H]), ([l3D, dUD and ([l5|), we have 



Z-^i ^ij _ z2i ^' 



«J 



+ 



na: 



2 



Z^i Xij n 2^j Xij 

1 v^n 



E^a^^i ^ n{-YJi=i{xij-XM) ) 



From constraint ([2]), we have xm = ^ ^^'^ Theorem [T] states that there 
exists at least n — d ■ m elements having Xij = 1 (i.e. on an average "" 
per bin). 
Thus, 



2_ji Xij n 2_^j Xi^ 



'^ij ~ m. 



Z^i^ij I Z^i=l\^i.' 



+ 



n Y.i Xi, 



i^V 



V T- n-dm (-i ]_\2 

n—dm /-I 



Y^ n-dm (-i 1 ^2 



n ^ 

m 



V T^ Y^ n-dm (-i 1 \2 

y^ Z-^ij^ ^ y^ l^i ^i] _^y^ ^7;~'>-^ ml 

E^. . n—dm /-I 1 \2 

_ »j -^^j , ^ ~i^^y^ ~ m) 

n {n-dm){l-^f 

— + m 



n n 

(n-dm)(l-^) 

> 1 + m ^^^ 

n 

dm , , 2 , , , 

= l + m(l 1 ) (15a 

n m 

dm 

= m — 1 -\ (2 — m) 

n 

~ m — 1 (n >> dm) 

Hence, the value of the objective function (~ m — 1) is close to it's upper 
bound (= m) indicating the near optimal usage of the bins. Any basic 
feasible solution would provide a near optimal packing when n » d ■ m I 

Corollary 6. For a fixed value of y^i^i-i! *^6 minimum value of » r ^' '^ 
occurs wlien all Xij 's are equal. Also, the minimum value is equal to Xij. 



Proof. From equations ([l2|), ([T3|), ([H]) and ([l5|), we have 



> XM 

The equahty holds only when all the Xjj's are equal I 

Any basic feasible solution for the relaxed LP will not necessarily be 
integral. However, from Theorem (Sj we have seen that any such solution 
will be close to the optimal integer solution. We now present an algorithm 
which will provide the near optimal integer solution. 

3 Approximation algorithm and it's bounds 



Algorithm 1 PackingVectors(P„, d) 
Require: An set of vectors pi,p2, ■ ■ ■ ,Pn'i Pn- 



{m,X) = SolveLP{Pn,d) 
if 771 > ^ then 

return FirstFit{Pn,d) 
else if 7TT, < y^ then 

return GreedyLP(Pn,X, d) 
else 

return IterativePack{Pn, X, d) 
end if 



Theorem 7. Algorithm 1 provides a 9{l)-optinial guarantee to the Vector 
Bin Packing problem (VBP). 

Proof. From the solution of the relaxed LP, the packing problem is clas- 
sified into 3 cases- 
Case 1 : m > ^ The optimal solution for an integer program is a feasible 
solution for the corresponding relaxed linear program. Thus, the optimal 
solution for a linear program is lesser than the optimal solution for an integer 
program (in a minimization problem). Thus, we have that - 

m< OPT 

n 

m> — 

- 2 



10 



Combining the above, we get - 

71 

OPT > m> - 
- - 2 

Since the total number of bins cannot exceed the number of vectors n, any 
first fit algorithm in the worst case can have an approximation factor of 2. 

Case 2 : m < ^f 

Since m < y^^, we have that - 

n > dm = m ■ dm 

Let n = k- dm, for some value of k. The equation (J15ap in Theorem [5] is then 

uTT) 2 

06j>l + m(l-— )(1 ) 

n m 

= l + ml-- 1-- 
k m, 

(m-2) 

= m, — I ; 

k 

If A: = il.{m,), the equation then becomes - 

Obj = m-l- 0(1) 

> m — 2 {k > m,) 

Thus, the value of objective function is > ?ti — 2, indicating a (near-)optimal 
utility of each bin. We use this knowledge and apply a greedy heuristic as 
given in Algorithm 2. 

From Theorem [H the algorithm completely packs a majority of the vec- 
tors into the bins (i.e. n — dm > dm{m — 1) > ^ for m > 2). Less than 
half of the vectors remain to be packed by the repeated iteration. Hence, 
the required bins < 2-OPT. 

Case 3 : § > m > ^f 
We find all the instances where ^^ xtjZij > |. From corollary[6l Yli XijZij > 
2 happens only when more than half of the non-zero values of Xjj's are 
greater than ^ or the standard deviation is fairly high. Also, the utility of 
the bin is more than ^. 

Only those bins whose utility exceeds half are chosen, and the values of 
Xij^s are sorted in descending order. The values of Xjj's less than half are 
ignored (less than half the number of non-zero Xjj's). The value of standard 

11 



Algorithm 2 GREEDYLP(P„,X,d) 



Require: An set of vectors pi,p2, ■ ■ ■ ,Pn'i Pn and a set of Xij values X 



1: 
2: 
3: 
4: 
5: 
6: 
7: 
8: 
9: 
10: 
11: 



P - P 

X = SortDescending{X) 

while a' 7^ $ do 

Remove the top element Xij in X 
if vector pi fits in bin j then 
Pack{i,j) 

Pn = P'n\{P^) 

end if 

A'=A'\{x,,} 
end w^hile 

PackingVectors{P^, d) 



Algorithm 3 IterativePack(P„, A, d) 



Require: An set of vectors pi,P2, ■ ■ ■ ,Pn'-i Pn and a set of Xij values A. 

1: 

2: 

3: 

4: 

5: 

6: 

7: 

8: 

9: 
10; 
11; 



Pji — Pn 

Z = FindDualObj{X, d) 

for J = 1 to r?^ do 

if Yli^ij^ij ^ \ then 

A- = SortDescending{Xj) 

A- = RemoveLessThanH al f {X ■) 

Pack{X'-) 

Pn = Pn\PackedVectors 
end if 
end for 

PackingVectors{P^^, d) 



deviation can also be high in which case, we have achieved our objective of 
increasing the gap between the values of Xij. 

We now proceed to packing the vectors into their respective bins. Since 
the number of Xjj's thrown away are less than half and the remaining val- 
ues of Xij's are > \. Atmost twice the number of bins are used to pack 
these vectors with Xij > 2- The remaining vectors are deferred to the next 
iteration. 

Thus, in each stage of the algorithm, the number of bins used is atmost 
twice the optimal since we are packing vectors with Xij > |. Hence, we have 



12 



proved that the number of bins used is atmost 2-OPT. 
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4 Appendix 

4.1 Dual formulation of the ILP 

minimize : > yj (16) 

j 

such that 2_^^^i ~ ^ 1 <i <n (17) 

j 
'^Pi.Xij <1 l<j<m,l<k<d (18) 

i 

Uj ^ Xij 1 < i < n,l < j < m (19) 

Xij G {0, 1} l<i<n,l<j <m (20) 

Multiply constraint (fTUj) by positive multipliers Zij corresponding to Xjj's. 
Adding all such constraints, we obtain - 

(^ Zij)yj > ^ XijZij I <j <m 

i i 

j i j i 



14 



XjnZ- 



V^V 



Further, we have - 

j j i j i 

subject to y^ Zij < 1 (21) 

i 

Thus, the ininimization problem can be reframed as a maximization problem 
with the constaint (j2ip and objective function being - 

i j 

Adding the new constraints and relaxing constraint (j20p . the dual problem 
is as follows - 



1 < i < n 

I <j <m,l<k <d 

1 < j < m 

1 < i < n,l < j < m 





maximize : 


* 3 


Zij 


such that 


j 


= 1 








> >?■ 


X^J < 1 






2 


< 1 








^ij 1 ^ij 


>o 
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